HEUN'S EQUATION, GENERALIZED HYPERGEOMETRIC 
FUNCTION AND EXCEPTIONAL JACOBI POLYNOMIAL 



KOUICHI TAKEMURA 

Abstract. We study Heun's differential equation in the case that one of the singu- 
larities is apparent. In particular we propose a conjecture that solutions of Heun's 
equation in this case also satisfy a generalized hypergeometric equation, which can 
be described in a more general form, and establish it in some cases. We demonstrate 
application of our results to exceptional Jacobi polynomials. 



1. Introduction 
The hypergeometric differential equation 

(1.1) z(l - z)0 + (7 - (a + + l)z) %-^V = 0, 

is one of the most important differential equation in mathematics and physics. Sev- 
eral properties of the hypergeometric differential equation, i.e. integral representation 
of solutions, explicit description of monodromy, algebraic solutions, orthogonal poly- 
nomials, etc. are studied very well, and they are applied to various problems in 
mathematics and physics. The hypergeometric differential equation has three sin- 
gularities {0,l,oo} and it is a canonical form of Fuchsian differential equations of 
second order with three singularities. Several generalizations of the hypergeometric 
differential equation have been studied so far. 

A generalization is given by adding regular singularities. Heun's differential equa- 
tion is a canonical form of a second-order Fuchsian equation with four singularities, 
which is given by 

(12) ^ I j 1 I - I - \ — H af3z - q y-0 

dz 2 \z 2 — 1 z — t J dz z(z — l)(z — i) 

with the condition 

(1.3) 7 + 5 + e = a + /3 + l, t ^ 0, 1. 

Heun's differential equation appears in several systems of physics including analy- 
sis of black holes ([18]), quantum mechnics (e.g. Inozemtsev model of type BC\ 
(|6J)), AdS/CFT correspondence (|9j), crystal transition ([IB]), fluid dynamics ([2]). 
The parameter q is independent from the local exponents and is called an accessory 
parameter. Although it is much more difficult to study global structure of Heun's 
differential equation than that of the hypergeometric differential equation, several 
special solutions of Heun's differential equation have been investigated. In the case 
that one of the regular singularities {0, 1, t, 00} is apparent, the solutions of Heun's 
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differential equation have integral representations ([20]). and the integral represen- 
tation is based on integral transformation of Heun's differential equation established 
by Kazakov and Slavyanov ([8]) (see also ([18])). Note that Shanin and Craster had 
studied the case of apparent singularity and obtained some other results ([IB]). On 
the other hand, if a G Z<o and q is special, then Heun's differential equation has 
polynomial solutions. We will investigate the case that Heun's differential equation 
has polynomial solutions and the regular singularity z = t is apparent. Propositions 
on the structure between two conditions will be given in section [5j 

Another generalization of the hypergeometric equation is given by increasing the 
degree of the differential. Let 



ai, a 2 , • • • , a p \ _ (ai) ri ,(a 2 ) w . . . (a p ) T 



b u b 2 ,...,b q ' J ^{b 1 ) n (b 2 ) n ...{b q ) n n\ 



z 



be the generalized hypergeometric function, where (a) n = a(a + 1) . . . (a + n — 1). 
Then it satisfies the generalized hypergeometric differential equation 



(1.5) 

dz \ dz 1 J \ dz q ) \ dz 1 ) \ dz 



In the case p = 2 and 5 = 1, the function 2 F\ (a, (3; 7; z) is called Gauss hypergeomet- 
ric function, and Eq.f ll.5p is just the hypergeometric differential equation. If p = 5+I, 
then the differential equation fll.5p is Fuchsian with singularities z = 0, 1, 00, and it is 
known to be rigid ([I]), i.e. there is no accessory parameter in Eq. (jl.5p . Consequently 
we have integral representations of solutions of the generalized hypergeometric differ- 
ential equation. 

In this paper we study some cases that the generalized hypergeometric differential 
equation is factorized and Heun's differential equation appears as a factorized com- 
ponent. Let -^ai,...,a q+ i;fei...fe, be the monic differential operator of order q + 1 such that 
,. bq y = is equivalent to Eq.(|L5J). For example 

h x T d?_ («i + a 2 + a 3 + 3)z - (h + b 2 + l) d 2 



dz 3 z[z — 1) dz 2 

[a\a 2 + aids + a 2 a s + a\ + a 2 + 03 + l)z — b\b 2 d a\a 2 a% 



z 2 (z- 1) z 2 (z- 1)' 

Letessier, Valent and Wimp ([11]) studied generalized hypergeometric differential 
equations in reducible cases. They proved that the function 



(l-^) p+rFq+'i 



d, . . . , a p , e x + 1, . . . , e r + 1 
61,62, . . . ,6 g ,ei, . . . ,e r 



satisfies a linear differential equation of order max(p, q + 1) whose coefficients are 
polynomials. We now explain it in the case p — 2, 5 = 1, r = 1. Let /o(^) = 
2-Fx (a,/3;7; z). Then the function fi(z) = z/q (z) /ei + /o(z) is equal to the function 

3 F 2 ( a, @ ,ei ^ j ^ J a nd it satisfies £ a)/ g )ei +i ;7)ei /i(z) = 0. On the other hand, it 
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also satisfies 

(1.8) L a ^, ei h{z) = 0, 

where 

d 2 / 7 a + (3 — 7 + 2 1 \ d a(3z — q 



1-9) = + — — j — ) Tz + 

^_ ei(ei + l-7) _ a/3(ei + 1)(7 - ei 



z(z - 1)0 - £)' 



(ei - a)(et - /3) ' ' (ei - a)(e 1 - f3) 

and we have the factorization 

/ d e x + 1 1 1 

(1.10) ia,ftei+l;7,ei — ( ~r ' ' 7 + 



J a,/3;7;ei 



(fc 2 Z — 1 Z — t / 

Since the point z = t is not singular with respect to the differential equation L Qj( g ei+1;7jei ?/ 
0, it is an apparent singularity with respect to I/ a ^ ;7;ei ?/ = 0. Maier ([12]) observed 
the fact conversely and established that Heun's differential equation with the ap- 
parent singularity z = t whose exponents are 0, 2 appears as a right factor of the 
generalized hypergeometric equation L a ^ jei+ i- 1)ei y = with a suitable value e\ (see 
Proposition 14. 2p . On the other hand, Heun's diffenrential equation whose singularity 
z = t is apparent (and e G Z<_i) is solvable in the sense that it admits integral 
representations of solutions, which we explain in section [3j Then it would be natural 
to ask that a solvale differential equation is related to rigid differential equation (i.e. 
the generalized hypergeometric equation). In this paper we generalize Maier's result 
and propose a conjecture; 

Conjecture. (Conjectured!) Set 

~ d 2 f 7 5 tt^-\ rrik \ d Smz m + • • • + Sq 



- + 



dz 2 \ z z — 1 ' z — t k J dz z(z — l)(z — ti) . . . (z — t M ) 



and assume that 0, 1, t%, . . . , tj^ are distinct mutually, mi, . . . ,rriM £ ^>i and the 
singularities z = tk of Ly = are apparent for k = 1, . . . , M. Then there exists a 
generalized hypergeometric differential operator -^a,^,ei+i,...,e JV +i;7,ei,...,e JV (N = mi + 
■ ■ ■ + m M ) and a differential operator D which admit the factorization 

(1-11) -^Q,/3,ei+l,...,ejv+l;7,ei,...,ejv = DL. 

Note that Heun's differential equation whose singularity z — t is apparent and e G 
Z<_! is included in the situation of the conjecture of the case M = 1. The following 
proposition is an evidence of supporting the conjecture; 

Proposition. (Proposition 14.11 ) The conjecture is true for the cases M = 1, uii < 5 ; 
M = 2, mi + ^2 < 4 and M = 3, mi = ni2 = = 1 . 

Gomez-Ullate, Kamran and Milson ((!]) introduced Xi-Jacobi polynomials as an 
orthogonal system within the Sturm-Liouville theory. They are remarkable and are 
stuck out the classical framework because the sequence of polynomials starts from a 
polynomial of degree one. Sasaki et al. ([I3J [17]) extended it to two types of X(- 
Jacobi polynomials (£ = 1,2,...) and studied properties of them. It is known that 
XrJacobi polynomials satisfy Heun's differential equation. We apply results in this 
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paper to Xj-Jacobi polynomials. Then we may understand a position of XpJacobi 
polynomials in the theory of Heun's differential equation. Moreover we establish that 
Xi-Jacobi polynomials are also expressed by generalized hypergeometric functions. 

This paper is organized as follows. In section EJ we review definitions and properties 
of Heun's differential equation, apparent singularity and Heun polynomial, which will 
be well known for specialists. In section [3j we recall an integral transformation of 
Heun's differential equation and its application to the case that singularity z = t is 
apparent. In section HJ we give a conjecture on Heun's differential equation with an 
apparent singularity and reducible generalized hypergeometric equation, and verify 
it for some cases. In section El we explain propositions in the case that Heun's 
differential equation has polynomial solutions and the regular singularity z = t is 
apparent. In section^ we give applications to Xi-Jacobi polynomials. In appendix, 
we give an outline of the proof of the conjecture in some cases. 



2. Heun's differential equation, apparent singularity and Heun 

polynomial 

We review some facts on a regular singularity and Heun's differential equation, 
which will be applied in this paper. 

2.1. Local solution. Let us consider local solutions of Heun's differential equation 

(2 1) —+(-+ 6 + 6 \ + ~ q y = 

dz 2 \z 2 — 1 z — t J dz z(z — l)(z — i) 

(■y + 5 + e = a + (3 + l) about z = t. The exponents about z — t are and 1 — e. If 
e ^ Z, then we have a basis of local solutions about z = t as follows; 

oo oo 

(2.2) f(z) = Y,c J (z-ty, (c ^0), g(z) = (z-ty-*J2 5 i(z-t) j , fa ^ 0). 

3=0 3=0 

The coefficients q are recursively determined by et(t — l)c\ + {apt — q)co = and 

(2.3) i{i + e - l)t(t - l)cj + {i + a- 2)(z + (5 - 2)q_ 2 

+ \{i - l)(i - 2)(2t - 1) + (i - 1){( 7 + 5 + 2e)t - 7 - e} + a(3t - g]cj_i = 0, 

for % > 2 (see [15]). Hence c, is a polynomial of the variable q of order i. 

2.2. Apparent singularity. If e £ Z< , then we have a basis of local solutions of 
Heun's differential equation as follows; 

00 00 

(2.4) f(z) = c;0* - W + A 9{z) \og{z - t), g(z) = (z - t) 1 ^ ^ c,(z - a)', 

3=0 3=0 

If the logarithmic term in Eq. (12.41) disappears, i.e. A = 0, then the singularity z — t 
is called apparent (see [5]). The terminology "false singularity" was used in ([16]). 
Note that the apparency of a regular singularity is equivalent to that the monodromy 
about z = t is trivial i.e. the monodromy matrix is the unit. 
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Now we describe an explicit condition that the regular singularity z — t of Heun's 
differential equation is apparent in the case e G Z< 1; which was also studied in Q16J). 
The condition is written as 

(2.5) (a-e-f)(/3-e-f)c_ e _ 1 

+ [e(e + l){2t - f) - e{( 7 + S + 2e)t - 7 - e} + apt - g]c_ e = 0, 

where ci, . . . , c_ e _i, c_ e are determined recursively by Eq. fl2.3p . and the condition is 
nothing but the case i = 1 — e of Eq. (12.31) (see (j5]) for a general theory). By setting 
n = 1 — e, we have 5 = a + (3 — 7 + n and the condition that the singularity z = t is 
apparent is written as P app (q) = 0, where P app (q) is a polynomial of the variable q of 
order n, which is also a polynomial of t, a, (3, 7. 

Example 1. (i) If e = (n = 1), then the condition that the regular singularity z = t 
is apparent is written as P app (q) = q — a (it = and it follows that the singularity 
z = t disappears. 

(ii) If e = — 1 (n = 2), then the condition that the regular singularity z = t is apparent 
is written as 

(2.6) P app (q) = q 2 - {(2a/3 + a + p)t - 7 + l}q + a/3t{(a + l)(/3 + l)t - 7} = 0. 

(Hi) If e = —2 (n = 3), then the condition that the regular singularity z = t is 
apparent is written as 

(2.7) 

P app (q) = g 3 + {(-3a/3 - 3a - 3/3 - l)t + (3 7 - 4)}g 2 

+ [{3a 2 (3 2 + 6a(3(a + 0) + 10a/3 + 2(a 2 + (3 2 ) + 2a + 2(3}t 2 
+ {(-6a/3 - 4a - 4/3) 7 + 4a/3 + 4a + 4/3}t + 2(7 - 1)( 7 - 2))q 
- a(3t{(a + l)(a + 2)(/3 + l)(/3 + 2)t 2 - 7 (3a/3 + 4a + 4/3 + 4)t + 2 7 ( 7 - 1)} = 0. 

2.3. Heun polynomial. Heun polynomial is a polynomial (or polynomial-type) so- 
lution of Heun's differential equation (see ([IS]) an d references therein). Polynomial 
solutions of Fuchsian differential equation have been also studied for a long time (see 
([13]) and related papers for reviews). Here we review a condition that Heun's differ- 
ential equation has a non-zero polynomial solutions of degree N—l. Then the solution 
has an asymptotic (1/ z) l ~ N as z — > 00 and we have 1 — iV = a or 1 — N = (3, because 
the exponents about z = 00 are a and /3. We now assume that 1 — a = iV e Z>o- If 
the accessory parameter q satisfies c^ = where c^ is determined by Eq. fl2.3p . then 
it follows from Eq. fl2.3j) in the case % = N + 1 that c^+i = 0. Thus we have q = 
for % > N + 2 and we obtain a polynomial solution of degree N — l. The polyno- 
mial solution is called Heun polynomial. Note that the condition c^ = is written as 
P (q) = by multiplying a suitable constant, where P po \q) is a monic polynomial of 
the variable q of order N, which is also a polynomial of t, /3, 7, e. (5 = (5 — N — 7 — e + 2) 

Example 2. (i) If a = (TV = 1 j and /3 ^ Z, £/ien i/ie condition for existence of 
non-zero polynomial solution of Heun's equation is written as P pd (q) = q = and a 
polynomial solution is y = 1. 

(nj If a = —1 (N = 2) and /3 ^ Z, i/ien i/ie condition for existence of non-zero 
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polynomial solution of Heun's equation is written as 

(2.8) P po \q) = q 2 + ((/3 - e)t + 7 + e)q + fi-yt = 0, 
and a polynomial solution is 

(2.9) y = t(t-l)e + (q + /3t)(z-t). 

(Hi) If a = —2 (N = 3) and ^ Z, i/ien i/ie condition for existence of non-zero 
polynomial solution of Heun's equation is written as 

(2.10) P pol (g) = g 3 + {(3,9 - 3e - l)t + 3 7 + 3e + 2}q 2 

+ {2(0 - e){0 - e - l)t 2 - 4(e 2 + (7 - + l)e - (2 7 + l)/3)i 
+ 2(7 + e)( 7 + e + l)}q + 4/3 7 t((/3 - e)t + 7 + e + 1) = 0, 

and a polynomial solution is 

(2.11) y = 2t 2 (t - l) 2 e(e + 1) + 2t{t - l)(e + l)(g + 20t)(z - t) 

+ {? 2 + ((3/3 - e + l)t + 7 + e)g + 20t{(0 + l)t + 7)}^ - t) 2 . 
Polynomial-type solutions of Heun's differential equation are written as 

(2.12) y = z e7 °(z- iy x {z -t) at p(z), 

where p(z) is a polynomial, do G {0, 1 — 7}, U\ G {0, 1 — 5}, a t G {0, 1 — e}. The 
condition for existing a non-zero polynomial-type solution in the case a = <j\ = a t = 
is described as a G Z< (or G Z< ) and P pol (g) = 0. The condition for existing a 
polynomial-type solution in the case a = 1 — 7, 0^ = 1 — S and o t = is described 
as e — a G Z<_i (or e — G Z<_i) and P(g) = 0, where P(q) is a polynomial of the 
variable q of order — e + a (or — e + 0). Then the order of p(z) is — e + a — 1 (or 
-e + /3-l). 

3. Integral transformation and its application 

Let p be an element of the Riemann sphere C U {00} and 7p be a cycle on the 
Riemann sphere with variable w which starts from a base point w — o, goes around 
w = p in a counter-clockwise direction and ends at w = o. Let [ 7z , 7p ] = 7 2; 7p77 1 7p 1 
be the Pochhammer contour. Kazakov and Slavyanov ([8]) established that Heun's 
differential equation admits integral transformations. 

Proposition 3.1. ([HQS]) Set 

(3.1) (77 - a)(r) - 0) = 0, 7' = 7 - 77 + 1, 5' = 8 - 77 + 1, e' = e - 77 + 1, 

{a',/3'} = {2-77, a + 277 + I}, 

g' = g + (1 - V ) (e + ft + (7 - 77) (* + 1)) ■ 

Let v(w) be a solution of 

, N d 2 v (i 5' e' \ dv a'0'w-q' 

aitr \7j; w — 1 w — tjdw w{w — l){w — t) 
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Then the function 

(3.3) y(z) = / v(w)(z — w)~ v dw 

is a solution of 

(*a\ d2y i i 6 t \dy , a(3z-q 

(3 ' 4) d^ + [i; + — + z—t)d-z + z(z-l)(z-t) y = > 

forpe {0,1, t, oo}. 

It was obtained in ( [20J ) that polynomial-type solutions of Heun's equation corre- 
spond to solutions which have an apparent singularity by the integral transformation. 
In particular we have the following proposition by setting r] — ft in Proposition 13.11 

Proposition 3.2. (|20j) J/eG Z< 0; a, (3, ft — 7, ft — 5 Z and i/ie singularity z = t 
of Eq. \3.4\ ) is apparent, then there exists a non-zero solution of Eq. A3.2\) which can 
be written as v(w) = w^~ 1 {w — l)P~ s h(w) where h(w) is a polynomial of degree — e 
and the functions 

(3.5) y P (z)= [ w^(w-iy- 6 h(w)(z-w)^dw, 

(p = 0, 1) are non-zero solutions of Eq. (3~4\ ). 

We may drop the condition a, ft, ft — 7, ft — 5 ft Z in Proposition 13.21 by replacing 
to that h(w) is a polynomial of degree no more than — e and the solutions in Eq. fl3.5p 
for p — 0, 1 may be zero. 

Corollary 3.3. If e e Z<o, a, (3, (3 — 7, /3 — 5 ft Z and the singularity z = t of 
Eq. H[3.4\) is apparent, then any solutions of Eq. I[3.4\ ) can be expressed by a finite sum 
of hypergeometric functions. 

Proof. It follow from Proposition 13.21 in the case e = and q = a(3t that the functions 



(3.6) F p (z)= w p -^{w-iy- a -\z-w)-^dw, 

(p = 0, 1) are non-zero solutions of hypergeometric differential equation, if a, ft, ft — 
7, ft - 8 ft Z. Since F (z) ~ z 1 " 7 (z -> 0) and F x (z) ~ (z - I) 7 " "/ 3 (2 -> 1), we have 

(3.7) F„(*) = d a ,p n z l -^F{a - 7 + 1, /9 - 7 + 1; 2 - 7; z), 

Fi(z) = d aAl {l - z) 7 - Q -^F( 7 - a, 7 - ft; 7 - a - ft + 1; 1 - 

where d a ^ n ,d a ^ n are constants. By expanding = X^o c i wJ ( res P- ^(w) = 

^~! Cj(l— and applying the formula, the functions yo(z) and 2/1(2;) are written as 
a finite sum of hypergeometric functions. If the functions yo(z) and yi(z) are linearly 
dependent, then yo(z) = Cyi(z) for some C G C \ {0}, yJ°(-2) = e~ 27rv/3T7 y (^)) 
^(z) = e 27rV ^ T ( 7 - Q - /3 )?/o(^) and = y^ ' 11 ^) = e 27r ^ a+ ^y (z), where y%(z) 

denotes the analytic continuation along the cycle 7. Since the exponents about z = 00 
are a and (3, we have e 271 "^" 1 *"" 1- ^ = e 27rv/ ~ Ta or e 2?rv/ ~ T/3 , and it contradicts to a, ft ft Z. 
Therefore the functions yo(z) and yi(z) are linearly dependent, every solution is 
written as a sum of them, and we have the corollary. □ 
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We describe Proposition 13.21 and Corollary 13.31 in the case e = —2 explicitly. 

Proposition 3.4. Set e = —2. The condition that the singularity z = t of Eg. ftcT4\ ) 
is apparent is written as Eg. \2. 7| j. Then there exists a non-zero solution of Eg. ( EJ| ) 
written as v(w) = w /3_7 (w — Vf 5 h(w) where 

(3.8) h(w) = 2a{a + l)w 2 + 2(a + l){q - a(fi + 2)t}w 

+ q 2 - {(2a/3 + 3a + /3 + l)t - 7 + 2}g + at{t(a + l)(/3 + l)(/3 + 2) - /3 7 }, 
and the functions 

(3.9) / w^{w-lf- s h{w){z-w)- p dw, 

(p = 0, 1) are solutions of Eg. \3.4\ )- If ce, (3, (3 — 7, (3 — 5 7h, then the functions 
in Eg. Ii3. 9\) are non-zero, and every solution of Heun's eguation with the condition 
that e = — 2 and the singularity z = t is apparent is written as an appropriate sum 
of the functions z 1 ~^ <+k F(a - 7 + 1, (3 - 7 + k + 1; 2 - 7 + k; z) (k = 0, 1, 2) and 
(1 - z y- a -P +k F(>y - a + k, 7 - P; 7 - a - /? + A; + 1; 1 - z) (k = 0, 1, 2). 

4. Generalized hypergeometric equation and Heun's differential 
equation with an apparent singularity 

We propose a conjecture on Fuchsian differential equations which have apparent 
singularities and generalized hypergeometric equations. 

Conjecture 1. Set 

d 2 , ( 7 5 m k \ d smz m + • • ■ + so 




dz z(z — l)(z — ti) ... (z — t M ) 

and assume that 0, 1, ti, . . . , t^ are distinct mutually, mi, . . . ,m M e Z>i and i/ie 
singularities z = t k of Ly = are apparent for k = 1, . . . , M. Then there exists a 
generalized hypergeometric differential operator -^o, ( g, ei +i,..., ejv +i; 7 ,ei,...,e JV (N = ni\ + 
m 2 + • • ■ + tum) which admits the factorization 

(4.1) -^o, / 3,ei+l,...,e JV +l;7,ei,...,ejv = DL, 

where D is a differential operator of order N whose coefficients are rational functions. 
The values a and B are determined by sm = ctf3 and 5 = a + (3 — 7 + iV + 1. 

Proposition 4.1. Conjecture [J\ is true for the cases M = 1, m\ < 5, M = 2, 

m\ + m2 < 4 and M = 3, mi = m 2 = m% = 1. 

We show an outline of the proof of the proposition in appendix. Note that the 
calculation is dependent on Maple (a computer algebra system). Here we express 
the generalized hypergeometric differential operators of the conjecture in the cases 
M = 1, m 1 = 1,2. Set 

d 2 /7 a + /5 , -7 + ?77 + l m \ d a(3z - q 

(4.2) H [t= _ m] = — +[- + — — - — + 



dz 2 \z z — 1 z — t J dz z(z — l)(z — t) 

The case M = 1 and mi = 1 is essentially due to Maier ([12]). 
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Proposition 4.2. ([12]) If the singularity z = t of Heun's differential equation 
H\ e= _\\y = is apparent (see Eg. \2. 6]) ). then the generalized hypergeometric differen- 
tial operator L a)/ g )ei +i ;7)ei admits the factorization 

( d ei + 1 1 1 \ 

(4.3) L ai/J , ei+1;7iei = + — + — + — j ^ = _ 1]; 

q-(a + l)(/3 + l)t + 7 

ei = rr t 

Correctness of the conjecture in the cases M = 1, mi = 2 follows from the following 
theorem, which is verified by straightforward calculations. 

Theorem 4.3. If the singularity z = t of Heun's differential equation written as 
H[ e= _2]y = is apparent (see Eg. \2. then there exists a generalized hypergeometric 
differential operator L a)j g )ei+ i je2+ i ;7jeijea which admits the factorization 

(4.4) 

( d 2 (e 1 + e 2 + 3 2 2 \ d \ 

L ^,e 1+ l,e 2+1 ; 7>ei) e 2 " ^ + ^ " + ^1 + ~ J dl + ^ J ^=" 2] ' 

(4.5) v{z) = [( ei + 3)(e 2 + 3)^ 2 + {g - (( ei + l)(e 2 + 1) + (a + 2)(/3 + 2))t 

- (ei + 3)(e 2 + 3) + 2 (7 + l)}z + t(ei + l)(e 2 + l)]/{z 2 (^ - l)(z - £)}, 
g- (a + 2)(/3 + 2)t + 2 7 



ei + e 2 = -3 + 



eie 2 = 2( ^ 1)2 [g 2 - {(2a/3 + 3a + 3/3 + l)t - (3 7 - 4)}g 

+ (a 2 /3 2 + 3a 2 /3 + 3a/3 2 + 7a/3 + 2a 2 + 2/3 2 + 2a + 2/3)t 2 
+ {2a/3 + 4a + 4/3 - 7 (3a/3 + 4a + 4/3)}t + 2(7 - 1)( 7 - 2)]. 

5. Polynomial-type solutions with an apparent singularity 

If e G Z<o, then the condition that z = t is apparent is written as P 3pp (q) = 0, 
where P 3pp (q) is monic polynomial of q with degree 1 — e. On the other hand, if 
a G Z<o and /3 G" Z<o, then the condition that Eq. fl3.4p has a polynomial solution is 
written as P pol (g) = 0, where P pol (g) is a monic polynomial of q with degree 1 — a, and 
the degree of the polynomial solution of Eq. fl3.4p is —a. In this section we investigate 
a relationship of equations P app (g) = and P pol (g) = in the case e G Z< and 
a G Z< 

Lemma 5.1. Assume that a G Z, e G Z and t/ie singularity z = t is apparent. Then 
the monodromy representation of solutions of Eq. ( fff-^| ) is reducible. 

Proof. Let yi(z), y^{z) be a basis of solutions of Eq.f l3.4p . Since the singularity 
z — t is apparent, the monodromy matrix around z = t is a unit matrix. Let 
_/^f(p) (jr, = 0, 1, 00) be the monodromy matrix on the cycle around the singularity 
w = p anti-clockwise with respect to the basis yi(z), y 2 (%)• For the moment we 
assume that 7 ,5 ^ Z. Then (resp. AfW) is conjugate to the diagonal matrix 
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with eigenvalues 1 and e 27rv ^ 7 (resp. 1 and e 277 ^^ 5 ). Since the exponents about 
z = oo are a, (3 and we have the relation M^M^ = (M (oo) ) _1 , the matrix M^M^ 
has an eigenvalue 1. Then the matrices and M^ l > have an common invariant 
one-dimensional subspace, because if we set 

the condition that M^M^ has an eigenvalue 1 is written as = 1 — tr(M^M^) + 
det (M^M^) = qr(d—l)(g — l)/ (qr—ps), and we have an common one-dimensional 
eigenspace for the case q = 0, r = 0, d = 1 or g = 1 respectively. In the case 
7 G Z (resp. 5 G Z), the matrix (resp. M^- 1 ') has the multiple eigenvalue 1, 

and we can also show that the matrices and have an common invariant 
one-dimensional subspace by expressing the matrices in the form of Jordan normal 
forms. Hence the monodromy representation of solutions of Eq. ( I3.4|) is reducible. □ 

Remark that Lemma loTTl is also a consequence of the multiplicative Deligne-Simpson 
problem for a special case ([7]). 

Proposition 5.2. Assume that a G Z ; e G Z< and the singularity z = t is apparent. 
Set n = — e(G Z> ). 

(i) If a > 0, then there exists a non-zero solution y(z) such that y(z) = z l ' 1 {z — 
l) l - 5 h(z) and h(z) is a polynomial of degree no more than a + n — 1 . 

(ii) If a < 1 — n, then there exists a non-zero solution y(z) such that y(z) is a 
polynomial of degree no more than —a. 

(Hi) If 1 — n < a < 0, then there exists a non-zero solution y(z) such that y(z) is 
a polynomial of degree —a or there exists a non-zero solution y(z) such that y(z) = 
z l ~^(z - l) l - 5 h{z) and h{z) is a polynomial of degree no more than a + n — 1 . 

Proof. Assume that /3 G" Z, 7 G" Z and /3 — 7 G" Z for the moment. It follows from 
reducibility of monodromy that there exists a non-zero solution y(z) of Eq. (13.41) such 
that y(z) = z do (z-l) 9l (z-t) 9t h(z) such that h(z) is a polynomial, h(0)h(l)h(t) + 0, 

6 G {0, 1 - 7}, 6 1 G {0, 1 - 5}, 6 t G {0, 1 + n}, and a = - deg h{z) - 6 - 6 1 - 6 t 
or (3 = —degh(z) — 6> — 9\ — 9 t (see [201 Proposition 3.1]). Since n G Z> and 
{z — t) n is a polynomial in z, we have a non-zero solution y(z) of Eq. (13.41) such that 
y (z) = z e °(z - l) 6l h(z) such that h(z) is a polynomial, h(0)h(l) ^ 0, 6 G {0, 1 - 7}, 

61 G {0, 1 — 5}, and a = — deg h(z) — 9 — 61 or = — deg h(z) — 9 — 61. Because 
deg h(z) is a non-negative integer, the possible cases under the consition a G Z, (3 G" Z, 
7 ^ Z and j3 — 7 = 5 — n — 1 — aG'Z are the cases deg h(z) = —a G Z> (a < 0, 
(0 O , 9 X ) = (0, 0)) and deg h(z) = a + n - 1 G Z> (a > 1 - n, (0 O , #1) = (1 - 7, 1 - 5)). 
Hence we have the proposition under the condition aGZ, /3 G" Z, 7 ^ Z and 
/3- 7 = ( 5-n-l-«^Z. 

Since the monic characteristic polynomial in g for existence of polynomial-type 
solutions = z*°(z - (/i(z): a polynomial, (0 o ,0i) = (0,0), (1-7,1-5)) 

is continuous with respect to the parameters j3 and 7, we obtain the proposition for 
all and 7 by continuity argument. □ 

Theorem 5.3. Assume that e G Z< 0; a G Z< and /J G" Z< . 

(%) If —a < — e and Heun's differential equation (Eq. ft3.4\ )) has a polynomial solution 
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(i.e. the accessory parameter q satisfies P po \q) = 0), then the singularity z = t is 
apparent (i.e. P 3pp (q) = 0). 

(ii) If — e < —a and the singularity z = t is apparent (i.e. P 3pp (q) = 0), then Eg. pO ) 
has a polynomial solution (i.e. P p (q) = 0). 

Proof, (ii) follows from Proposition 15.21 (ii). 

We show (i). If e G Z< , then a basis of local solutions about z = t is written as 

oo oo 

(5.2) f( z ) = { z - 1) 1 - c & - ty, g(z) = ~ c -m - ty + 4f (*) - o- 

3=0 3=0 

Apparency of the singularity z = t is described as the condition A = 0. If there exists 
a polynomial solution y = p(z) of Eq. (13.41) . then deg z p(z) = —a < — e. Since the 
expansion of f(z) starts from 1 — e, the solution p(z) is proportional to g(z). Hence 
A = and we obtain (i). □ 

Proposition 15.21 and Theorem 15.31 are also valid for the case the singularity z = 
or z = 1 is apparent. 

6. X 1 Jacobi polynomial 

We now review a definition of X\- Jacobi polynomials and their properties ([H [T3J 
fTTj). Let P k (rj) be the Jacobi polynomial parametrized as 



rfi1 ^ pM _ (9+jh ^ (-k) j (k + g + h + 2) s f l-y V 



The Xj-Jacobi polynomials Pk{v) (k = 0,1,2,...) are defined in the case g,h (jL 
{-1/2,-3/2,-5/2,...} by 

(6.2) p k ( V ) = k+ l + i_ (V + mv)p k (v) + (1 + v)av)-^Pk(v?j , 

g-h g+h+1 ~ g-h g+h+3 
fW = — 2~ r l + g ' = ~ 2~ V 2 ' 

Hence deg^ P k (rj) — k + 1. The X\- Jacobi polynomials in the case g,h > —1/2 are 
orthogonal with respect to the following inner product; 



(6.3) J P k (r))P k ,(r))W(r))dv = C k 5 k , k/ , Wfa) 



(1 -r]y+i(l + v ) h+ h 

29+^+2^(^)2 



where C k is a non-zero constant. The Xi- Jacobi polynomial Pk{v) satisfies the fol- 
lowing differential equation; 

(6.4) (1 - v 2 )^Pk(v) + (h-g-(g + h + 3) V - 2 (1 ~f } f (fy) > ) ^P k ( V ) 



drf \ " £(77) / drj 

+ k(k + g + h + 2)+g-h) P h {rj) = 0. 
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By setting 77 = 1 — 2z and y = Pk(v)i we obtain a specific case of Heun's differential 
equation whose parameters are given by 

(6.5) 

a = -k-1, (3 = k + g + h + 1, 7 = 3 + 3/2, 5 = a + (3 - 7 + 3 = h + 3/2, 
1-7 9 + 1/2 



-2, t 



a + /3 - 27 + 3 g-h 



(1 - 7)(a , + 2a + 2 , 2 7 + 4) = (g+1/2) + + h + + _ 
a + /3 — 27 + 3 a — <? 

The condition that the singularity z — t of the differential equation 
d 2 w /7 a + /3 - 7 + 3 2 \ <fu a/3z - g 

(6 - 6) d? + [z + ^^i — t )d; + z(z-i)(z-t) y = > 

is apparent is written as Eq. (12.7ft . By substituting t = (1 — 7)/(a + /3 — 27 + 3) into 
Eq. (12.71) . we have the factorization 

(7-l)(a/3 + 2a + 2/3-2 7 + 4)~ 



(6.7) g + 



a + f3 - 27 + 3 

a 4 7 2 -(: 

5" 



2 4 7 2 - (2a(3 + 4a + 4/3 + 12) 7 + (2a/3 + 5a + 5(3 + 9) 



a + /3-27 + 3 
a/% - 1)(4 7 2 - (a/3 + 4a + 4/3 + 8)7 + (a + l)(/3 + 1) 



0. 



(a + /3 - 2 7 + 3) 2 

Hence the singularity z = t = (1 — j)/(a + (3 — 27 + 3) is apparent with respect to the 
second order differential equation which Xi-Jacobi polynomial -F\(l — 2z) satisfies. 
It follows from Proposition 13.41 that the differenitial equation ( 16. 2 j) admits integral 
representation of solutions written as 

(6.8) /" {(A; + - - C) 2 + (2g + l)(2k + 2h + 3)C}- 

where p = —1, 1. 

Next we investigate the condition that Eq. ( 16 . 6 p has a non-zero polynomial solution 
under the assumption that the singularity z = t is apparent (see Eq.( l2.7l) ). If a = 
— k — 1, /3 7^ and k G Z>i, then it follows from Theorem 15.31 that the differential 
equation has a non-zero polynomial solution. If a = — 1 (k — 0), then the condition 
that the differential equation has a non-zero polynomial solution is written as Eq. (I2.8P 
and we have 

(6-9) ( q -l + 1 )( q -—±L—]=Q. 



/3-2 7 + 2 / 

by substituting t — (1 — 7)/(— 1 + /3 — 27 + 3) and e = —2. On the other hand we have 
q = 1 — 7 by Eq. ()6.5p in the case = (a = — 1). Hence we confirm that there exists a 
non-zero polynomial which corresponds to the Xi-Jacobi polynomial in the case k = 0. 
If a = 0, then the condition that the differential equation has a non-zero polynomial 
solution is written as q = and a solution is constant, and it does not agree with 
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Eg. (16.51) . i.e. q = 2(1 — y)(/3 — y+2)/(/3 — 27 + 3). Hence the constant does not belong 
to parameters of Heun's differential equation concerning to Xx-Jacobi polynomials. It 
follows from apparency of the singularity z = t = (1 — y) / (/3 — 2y + 3) and Proposition 
15.21 that there exists a non-zero solution y(z) of Heun's differential equation with the 
parameters in Eq. (I6.5j) such that y(z) = z x ~~<{z — \) l ~ 5 h(z), degh(z) = 1 and the 
polynomial h(z) is calculated as h(z) = (j3 — 2y + 3)z + y — 2. 

It follows from Theorem 14.31 and apparency of the singularity z = t that the poly- 
nomial Pfc(l — 2z) also satisfies the generalized hypergeometric differential equation 

L-k-l,k+g+h+l,e 1 + l,e 2 +l;g+3/2,e 1 ,e 2 y = 0) where 

(6.10) ei + e 2 = 2y-3 = 2g, 

aP(y- 1) -(k + l)(k + g + h + l)(2g + 1) 
6162 ~-y + 2 + a + (3~ 2h + 1 

Thus we have the following proposition; 

Theorem 6.1. The Xi-Jacobi polynomials are expressed in terms of generalized hy- 
pergeometric functions, 

(6,d w,( - k - 1 - k+ /;^2 + 1,62+1 

(6,2) e 1 + e 2 = 2 9 , , iej= -(* + D(* W + D^ + D , 
where is a non-zero constant. 

Proof. Let Qk{v) be the generalized hypergeometric function defined by the right 
hand side of Eq.( 16.11|) . Then the functions Qk(l — 2z) and P&(1 — 2z) are holomorphic 
solutions of the generalized hypergeometric differential equation 

(6-13) L-k-l,k+g+h+l,ei+l,e 2 +l;g+3/2,ei,e 2 y = 

about z = 0, where e\ and e 2 are given by Eq. fl6.12p . The exponents of the differential 
equation about z = are 0, — g — 1/2, 1 — e\ and 1 — e 2 . If g + 1/2, ex, e 2 ^ Z, then the 
dimension of holomorphic solutions of the differential equation is one and the function 
Pfc(l — 2z) is proportional to Qfe(l — 2z). By continuity argument, the function 
i\(l — 22;) is proportional to Qfc(l — 2z) in the case g,h ^ { — 1/2, —3/2, —5/2, . . . }, 
the case that the functions are well-defined. □ 

7. Concluding remarks 

It is known that two types of JQ-Jacobi polynomials (£ = 1,2,...) satisfies a 
second-order Fuchsian differential equation which satisfies the assumption of Conjec- 
ture[TJby setting r] = l — 2z (see ([HUT]) etc.). Thus relationships between JQ-Jacobi 
polynomials and generalized hypergeometric polynomials should be studied further. 
On the other hand, several researchers including the authors in ([lj [3j [10]) stud- 
ied generalized Jacobi polynomials. It would be interesting to consider relationship 
among those polynomials. 
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Appendix A. Sketch of the proof of Proposition 14.11 

We give a sketch of the proof of Proposition 14. 1[ 

Let L be the differential operator in Conjecture [TJ Write 

d N N-l dj _ _ N+l dj 

^'^ ^ = dz" + ^ Vi ^dtf' L «Aei+l,..,e w +l; 7 ,e ll ... 1 e JV ~ DL = W ^J7o 
3=0 j=0 

and impose the condition Wj(z) = (J — 0, . . . , N + 1) by choosing the coefficients 
Vj(z) of D appropriately. The coefficients Vn-j(z) (j = 1,...,N) are determined 
recursively by the condition u)N+2-j(z) = 0. If we can show W\(z) = Wq(z) = by 
using the condition (apparency of singularities) of the conjecture and by choosing the 
values of ei, . . . , e^r appropriately, then the conjecture for the operator L is true. We 
show it in the case M — 1, mi < 5, the case M = 2, mi + m 2 < 4 and the case 
M — 3, mi — ^2 — m 3 — 1 with the aid of Maple. Let e, be the i-th elementary 
symmetric function, i.e. e« = Si<j 1 <-<j i <jv e h ■ ■ ■ e n- The functions wo(z) and wi(z) 
are rational, and every coefficient of the numerators of Wq(z) and Wi(z) in the variable 
z is a polynomial in ei, . . . , Cjv, 7, 3, s , . . . , %, which is also dependent on t 1; . . . , tu- 

We investigate the case M = 1 and m x G {1,2,3,4,5}. The differential operator 
L is written as if[ e= _ mi j. Every coefficient of the numerators of Wq{z) and W\(z) in 
z is linear in ei, . . . , Zn- We can solve the simultaneous equations determined by any 
coefficients the numerators of W\(z) in the variable ei, . . . , Cjv- The solution ei, . . . , Cjv 
exists uniquely and tj (j = 1, .. - ,N) are expressed as polynomials in q, a, /3,7 and 
are homolorphic in t e C \ {0, 1} (see Eq.f l4.5p in the case mi = 2). By the way, 
apparency of the singularity z = t is written as P 3pp (q) = 0, where P 3pp (q) is a 
polynomial of g of degree mi + 1. We evaluate the solution ei, . . . , ejv in Wq{z). Then 
we can confirm that all coefficients are vanished by using the relation P 3pp (q) = 0, 
and we obtain correctness of the conjecture in the case M = 1 and mi < 5. 

We investigate the case M > 2. Set N = mi + ■ ■ ■ + m M and write 

(A.2) L= ff 1 + a + 0- 1 + N + l _ 



dz 2 \ z 




M 



a/3 m-^ p k 



z ( z ~ l ) ^ z{z- l){z-t k ) 

The condition that the singularity z — tj (j — 1, . . . , M) is apparent is written as 
Pj PP (pi, . . . ,pm) = 0, where P* pp (pi, . . . ,Pm) is a polynomial of Pi, ■ ■ ■ ,Pm such that 
deg^ P- PP (pi, ■ ■ ■ ,Pm) = rrij + 1 and deg Pj , P/ pp (pi, • • • ,Pm) < m,j (j ; 7^ j). We 
assume that M = 2, (mi,m 2 ) = (1,1), (2,1), (2,2), (3,1) or M = 3, m x = m 2 = 
m.3 = 1. We expand the numerator of W\(z) as Co + t\{z — 1) + • ■ ■ + Cn'{z — 1) N 
for some N' and solve the simultaneous equations Co = ■ ■ • = Cat_i = for the 
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variables ei, . . . , Cat- The solution Ci, . . . , ejy exists uniquely and tj (j — 1, . . . , N) are 
expressed as polynomials in p 1 , . . . ,Pm, ot, (3, 7 and may have poles along tj(tj — 1) = 
(j = 1, . . . , M) and tj — tj' — (1 < j < f < M). We evaluate the solution ei, . . . , Cjv 
in Wi(z) and wq(z). Then we can confirm that all coefficients are vanished by using 
the relation P* pp (pi, . . . ,pm) = ■ ■ ■ = P* pp (pi, . . . ,Pm) = 0, and we obtain correctness 
of the conjecture in the case M = 2, mi + iri2 < 4 and M = 3, m\ = m<i = rris = 1. 
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